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ABSTRACT 


Recently  introduced  generalizations  of  the 
median  filter  (namely  the  o-trimawd  aean  and 
modified  trimmed  mean  filters)  are  reviewed  and 
related  to  a  class  of  nonlinear  filters  called 
selective  averaging  filters,  and  two  new  filters 
are  defined.  These  filters  are  examined  for 
performance  on  noise-corrupted  leaves  and  shown  to 
have  good  smoothing  characterlst ics  without  edge 
smearing. 

I .  INTRODUCTION 

The  simple  nonlinear  action  of  the  median 
filter  allows  it  to  generally  preserve  edges  while 
suppressing  impulsive  noise  components  quite  well. 
Median  filtering,  however,  mav  fail  to  provide 
sufficient  smoothing  of  non-lmpulsive  noise 
components  such  as  white  Gaussian  noise.  Several 
new  filters  have  recently  been  studied  as 
generalizations  of  the  median  filter.  Spec¬ 
ifically,  the  a- trimmed  mean  filter  (o-TM  filter) 
[1-3|  and  the  modified  trimmed  mean  filter  (NTH 
filter)  [3]  have  been  proposed  as  useful  new 
nonlinear  filters.  The  class  of  nonlinear  filters 
called  selective  averaging  filters  (4),  which 
includes  the  K-neareat  neighbor  filter  ( K-NN 
filter)  [4,5),  can  be  related  to  these  gen¬ 
eralized  median  filters.  He  will  examine  this 
relationship  in  Section  II  and  from  this  re¬ 
lationship  will  be  able  to  define  two  other  >  -a 
filters,  the  median  K-nearest  neighbor  filter  (MED 
K-XS  filter)  and  the  modified  nearest  neighbor 
filter  <MNN  filter).  In  Section  III  we  will  give 
results  of  experiments  in  which  these  filters  are 
applied  to  noisy  images. 

All  of  the  filters  considered  in  this  paper 
are  local  image  enhancement  techniques  in  which 
each  pixel  is  replaced  by  a  value  obtained  through 
an  operation  performed  on  a  neighborhood  H  of  the 
pixel.  The  size  of  a  window  or  neighborhood  is 
the  total  number  of  pixel  locations  in  it.  He 
will  generally  be  interested  in  odd  window  sizes 
which  we  will  write  as  2N+1  for  an  integer  N. 

The  output  y)t,ji  of  an  o-TM  filter  of  window  site 
2Nel  at  pixel  location  (k,l)  for  an  input  image 
[xkig>  is  the  average  value  of  pixels  remaining  in 
the’wlndow  after  the  T  ■  f«(2Nel)|  largest  and 
smallest  pixels  are  discarded,  with  a  being  some 
parameter  constrained  by  0  i  a  S  0.5.  The  NTH 
filter  first  determines  the  sample  median  m^g  of 
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pixels  within  the  window  cantered  on  any  pixel 
location  (lt,f),  and  then  chooses  an  Interval 
[m^g-q,  nk  >*qj  using  sosm  pre-selected  constant 
q.  Hlthin  the  window,  data  samples  outside  this 
range  are  diacarded  and  the  average  value  of  the 
rest  of  the  data  is  used  as  the  output.  MTM 
filtering  can  be  thought  of  aa  a  modification  of 
o-TM  filtering  [3|.  Note  that  the  number  of 
values  used  in  averaging  is  not  fixed  a  priori  in 
MTM  filtering,  while  it  is  fixed  as  2(N-T)el  in 
e-TM  filtering.  The  MTM  filter  is  able  to  reject 
isrpul s lve  noise  components  because  for  each  output 
it  starts  by  obtaining  the  median  value  inside  the 
corresponding  window.  Mote  that  the  MTM  filter 
also  treats  its  ordered  data  within  a  window  in  a 
non-symsMtrlc  way  depending  on  the  data. 

The  window  sites  of  o-TM  and  MTM  filters  are 
constrained  aa  in  median  filtering.  If  a  narrow 
pulae  of  the  original  image,  composed  of  I  pixels 
is  to  bo  preservod,  then  the  maximum  window  site, 
allowed  is  21-1  in  the  noise-free  case.  To 
overcome  this  difficulty  a  double-window  (DW) 
variation  of  the  MTM  filter  has  been  Introduced 
(31.  In  the  double-window  MTM  filter  (Of  MTM 
filter)  windows  of  size  2N+1  and  2L+1,  with  L  >  N, 
are  centered  at  (k,R).  First  the  sample  median 
mfc'g  is  computed  from  Che  small  window  of  size 
2N+1.  For  soma  positive  number  q  an  interval 
[mk>g-q,  mkig+q]  is  chosen.  Then  the  aean  of 
poincs  lying  wlchin  the  interval  Jmj^g-q,  mg  g+q) 
among  the  samples  in  the  larger  window  of  size 
2L+1  Is  computed  as  the  output.  The  condition 
concerning  preservation  of  a  narrow  pulse  composed 
of  I  connected  pixels,  namely,  2N+1  i  21-1,  is  a 
necessary  but  not  sufficient  condition  in  the 
two-dimensional  case  (it  is  sufficient  and 
necessary  in  one  dimension).  In  general  we  can 
say  that  a  narrow  pulse  composed  of  I  pixels  will 
always  be  preserved  by  median  filtering  of  window 
size  2N+1  S  21-1  if  at  leaat  N+l  pixels  of  the 
narrow  pulse  are  included  in  the  window  whenever 
the  subject  pixel  (center  of  the  window)  comes 
from  the  narrow  pulse. 

II.  RELATIONSHIP  OF  GENERALIZED  MEDIAN  FILTERS 
TO  SELECTIVE  AVERAGING  FILTERS 

Selective  averaging  (4)  refers  to  a  class  of 
local  image  enhancement  techniques  which  are 
designed  specifically  to  not  average  across  edges, 
or  lines.  At  each  pixel,  called  the  subject 
pixel,  every  value  in  Its  window  Is  examined. 
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Than  th*  general  idea  is  chat  only  those  pixels 
coming  from  the  saaM  region  (for  example,  same 
side  of  an  edge)  as  the  subject  pixel  are  averaged 
and  the  rest  are  discarded.  Note  that  the  gen* 
eralized  median  filters,  especially  the  a-TM  and 
MTM  filters,  follow  the  same  general  policy  except 
that  they  average  pixel  values  close  to  the 
median  pixel.  In  particular,  one  selective 
averaging  technique  called  the  K*nearest  neighbor 
filter  (K-NN  filter)  (4,5)  will  now  be  shown  to 
be  closely  related  to  a-TM  and  MTM  filters. 

Two  versions  of  a  K-NN  filter  My  be  defined. 
In  the  first  version  (K-NNi>,  *n  •*c^  window  the 
filter  averages  a  fixed  number  K  of  values  closest 
to  the  subject  pixel,  including  the  pixel  itself, 
where  K  is  an  Integer  less  than  or  equal  to  the 
window  size  2N+1.  The  output  is  then  this 
averaged  value.  This  K-NNj  filter  is  similar  to 
the  a-TM  filter  in  the  sense  that  it  averages  a 
fixed  number  of  selected  values  Inside  each 
window.  Thus  in  non-impulslve  noise  suppression 
the  K-V.Vj  and  the  a-TM  filters  can  be  designed  to 
have  similar  perforsanesa  (by  choosing  K  • 
2<N-T)+l).  However,  impulsive  noise  components 
cannot  be  suppressed  effectively,  in  general,  by 
averaging  the  values  within  a  window  which  are 
close  to  the  value  of  the  center  pixel.  This  is 
because  the  center  pixel  itself  My  have  been 
corrupted  by  an  impulsive  noise  component. 
Generalized  median  filters  can  suppress  impulsive 
noise  because  they  average  values  close  to  the 
median.  On  the  other  hand,  the  K-NNj  filter  has  a 
non-symmetric  data-dependent  smoothing  property  as 
in  MTM  filtering.  It  always  sverages  K  con¬ 
secutive  pixel  values  from  amongst  the  ordered 
set,  but  the  location  of  these  values  in  the 
ordered  set  is  not  fixed.  Thus  the  K-NN}  filter 
can  be  more  effective  than  the  a-TM  filter  in  edge 
preservation  for  properly  chosen  K;  for  example, 
when  a  3  x  3  symMtrlc  square  window  la  used  the 
K-NNj  filter  with  K  S  6  will  preserve  a  noise-free 
step  edge  with  a  horizontal,  vertical  or  diagonal 
orientation.  In  addition,  iterated  use  of  the 
K-NN}  filter  can  result  In  impulsive  noise 
suppression,  because  at  each  Iteration  the  value 
of  an  impulsive  component  is  reduced  and 
non-impulsive  components  are  not  influenced  by  the 
presence  of  impulsive  components. 

In  K-NM}  filtering  the  window  size  can  ba 
chosen  more  freely  because,  for  a  fixed  K, 
different  window  sizes  generally  do  not  result  in 
verv  different  perfonaancea  aa  long  as  they  are 
all  reasonably  big.  We  can  observe  this  ex¬ 
plicitly  In  the  one-dimensional  case,  in  which  K  & 
N+l  is  the  necessary  and  aufflclsnt  condition  for 
the  preservation  of  noiae-free  step  edges,  and 
both  K  1  KM  and  K  i  I  are  the  necessary  and 
sufficient  conditions  for  the  preservation  of  a 
noise-free  narrow  pulse  of  duration  I;  nota  that 
such  s  narrow  pulse  can  generally  ba  written  as 

(0  ,  k <  j 

xk  •  (  Hi  J  S  k  <  J+I  (1) 

(  «2  j  ♦  I  S  k 

where  J  1.  «n  integer  and  Hj  «  0,  83  «  Hj.  Thu.  a 
larg.  window  alia  can  be  chosen  without  distorting 


narrow  pulses,  although  tha  dagraa  of 
non- inpul a ive  noiaa  auppraaaion  ia  not  changed  by 
increaalng  window  site  for  a  fixad  K.  In  tha 
two-dlnana tonal  caaa  tha  condltiona  K  £  N+l  and  K 
S  I  hava  to  ba  nodiflad,  dapending  on  the  chapes 
of  tha  window,  tha  narrow  pulaas  and  adgaa.  For 
lnatanca,  whan  a  syunetric  square  window  of  size 
2N+1  la  used,  horizontal  or  vartlcal  edgas  will  be 
preserved  by  choosing  K  i  vOTTT  ( .2M+1+1 ) 12.  Con- 
carnlng  tha  prasarvatlon  of  two-dinensional 
narrow  pulaas,  a  statanent  slnllar  to  the  one 
mentioned  at  tha  and  of  tha  pravioua  asctlon  can 
ba  aade;  a  narrow  pulsa  conposad  of  1  pixels  will 
be  pre.erved  by  K-NN  filtering  with  K  S  I  if  all 
of  the  pixels  in  tha  narrow  pulsa  are  included  in 
the  window  whenever  the  subject  pixel  la  part  of 
tha  narrow  pulsa. 

Wa  should  nota  that  in  [4,5]  a  filter  has 
baan  defined  (which  we  will  describe  aa  tha  K-NN2 
filter)  in  which  the  subject  pixel  is  excluded 
from  the  averaging.  In  othar  worda,  the  window  U 
doaa  not  Include  the  subject  pixel.  U.e  of  this 
type  of  window  for  the  K-NN  filter  nay  hava  an 
advantage  In  that  tha  filter  can  suppress  isolated 
lnpul.lv.  nol*.  conpon.nt*.  However,  for  both 
R-NN  filters  Impulsive  noiaa  suppression  can  be 
achieved  by  repeated  filtering. 

The  a-TM  filter  sv.r.g.s  a  fixad  nunbar  of 
values  symmetrically  in  a  neighborhood  of  th. 
median,  and  la  a  direct  extension  of  a  median 
filter.  Tha  R-NN  filter  averages  a  fixed  number 
of  values  in  a  neighborhood  of  tha  subject  pixel, 
which  results  in  non-aynnetric  treatment  of  the 
ordmrad  data,  and  may  ba  viewed  aa  an  extension  of 
an  identity  filter.  This  comparison  brings  up  tha 
possibility  of  a  symmetric  K-NN  filter  averaging  a 
fixed  number  of  valuos  ae  a  direct  axtansion  of 
tho  Identity  filter  and  a  counterpart  of  tho  a-TM 
oxtonslon  of  tho  modlan  flltog.  For  lnatanca,  in 
tho  one-dlmonalonal  caaa,  whan  tho  aubjact  pixel 
ia  xk  a  symmetric  K-NNj  filter  may  ba  doflnod  to 
aaloct  (K-D/2  samples  from  oach  of  tha  sets 

| k-N  i  1  <  kf  and  (xt|k  <  1  S  k+N| ,  for  an  odd 
R.  However,  this  extension  of  the  Identity  filter 
can  be  expected  to  neither  preserve  edges  wall  nor 
auppreaa  Impulsive  nol.e  component,  and  will  not 
ba  considered  further.  On  the  other  hand,  one  can 
also  think  of  a  non-. vroe trie  a-TM  filter  which 
average,  a  fixed  number  of  value,  in  a  neigh¬ 
borhood  of  the  median  aa  in  a-TM  filtering,  but 
with  possibly  a  different  number  of  values 
aalacted  from  either  side  of  tha  median.  Thl. 
leads  to  a  filter  which  avaragaa  K  pixels  whose 
gray  levels  are  closest  to  the  median  amongst  the 
gray  levels  in  any  window;  we  will  refer  to  It  aa 
the  median  K-NN  filter.  The  window  sizes  of  tha 
median  K-NN  filter  are  restricted  aa  in  median 
filtering,  while  R  is  chosen  as  In  K-NN  filtering. 

MTM  filtering.  In  which  a  variable  number  of 
values  are  averaged  non-avmamtrlcallv  in  a 
neighborhood  of  the  median,  can  ba  thought  of  aa  a 
modification  of  mmdlan  R-NN;  filters.  The  K-NN 
filters  can  be  modified  to  average  a  variable 
number  of  samples  non- symmetrically  In  tha  same 
way  that  tha  median  R-NN]  filter  can  be  modified 
to  give  the  MTM  filter.  This  leads  ua  to  filters 
which  will  ba  called  tha  modified  nearest  neighbor 
filter.  (KNN  filters).  The  NNN  filter,  averag. 
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value*  lying  within  son*  interval  C q .  x^+q] 
amongst  the  value*  in  their  window,  where  xjj  i* 
the  gray  level  of  the  subject  pixel. 

The  MNNj  filter  cannot  suppress  iapulaive 
noise  coaponents  effectively  even  with  iterated 
us*  because  it  averages  value*  close  to  the  sub¬ 
ject  pixel  value  in  any  window;  however,  it  can 
saooth  non-iapulsive  noise  without  blurring.  The 
behavior  of  the  HNSj  filter  varies  froa  that  of 
the  identity  filter  (no  filtering)  when  the 
subject  pixel  has  been  corrupted  by  an  Impulsive 
noise  to  that  of  the  running  mean  filter  when  the 
subject  pixel  is  located  in  a  slowly  varying 
portion  of  the  image,  for  a  properly  chosen  q. 

We  have  noted,  in  Section  II,  that  a  DW  MTM 
filter  allows  one  to  achieve  more  smoothing 
without  severe  loss  of  narrow  pulses  in  an  image. 
Increasing  the  window  site  of  an  MTM  filter 
directly  does  not  allow  this  advantage  to  be 
obtained.  In  MNNj  filtering,  increasing  the 
window  site  does  allow  more  smoothing  without  loss 
of  narrow  pulses  for  a  properly  chosen  q;  of 
course,  MNN;  filtering  docs  not  give  impulsive 
noise  rejection.  For  instance,  the  one- 
dimensional  noise-free  narrow  pulse  of  (1)  will 
be  preserved  for  any  window  site  a*  long  as 

q  <  min  IHj ,  Ho,  (Hj-Hjlj.  (2) 

If  only 

q  <  min  (Hj,  H2I  (3) 


either  100  or  ISO,  and  a  sinusoidal  part  whose 
maximum  amplitude  was  ISO  snd  minimum  amplitude 
was  100.  The  height  of  edges  was  SO  except  for 
the  lower  diagonal  one  ( see  photograph*  on  the 
next  page)  whose  height  was  35.  Each  cross-shaped 
narrow  pulse  was  composed  of  12  pixels  having  a 
constant  gray  level  of  ISO.  Two  types  of  noise 
were  added  to  the  original  image;  sero-aean  white 
Gaussian  noise  with  standard  deviation  10  and  100 
impulses  which  occurred  at  random  positions,  with 
gray  levels  2 SO.  The  filters  discussed  so  far, 
with  a  3  x  3  square  window,  were  applied  to  the 
noisy  image  and  this  application  was  iterated 
three  times.  (The  notation  31  In  the  photographs 
stand*  for  ”3  iterations").  In  DW  MTM  filtering  3 
x  3  and  7x7  square  window*  were  used.  The 
MNNi  filter  was  also  used  with  a  7  x  7  square 
window  on  3  x  3  square-window  median  filtered 
data.  The  parameter  K  for  the  I-H|  and  median 
R-NNj  filter  was  chose  to  be  6  and  the  parameter 
q  for  the  MTM,  DW  MTM  and  MNNi  filters  was 
chosan  to  be  30  (l.e.  q-H-2« ,  except  for  the  lower 
diagonal  edge). 

The  MTM  filter  after  three  iterations  1*  seen 
to  be  better  in  noise  suppression  than  the 
iterated  median,  median  K-NN]  and  K-RN[ 
filters,  which  give  a  more  mottled  appearance. 

The  results  of  the  DW  MTM  filter  and  the  median 
filter  followed  by  the  MNNi  filter  are  seen  to 
be  quite  similar  and  better  than  all  the  other 
results. 


holds  the  puls*  is  alio  preserved,  as  long  aa  the 
window  size  is  not  larger  than  21*1.  Not*  that 
the  DW  MTM  filter  also  preserves  the  puls*  (1), 
as  long  as  the  condition  (2)  holds  and  the  small 
window  size  i*  not  larger  than  21-1,  for  ar¬ 
bitrarily  large  window  size.  If  only  (3)  holds 
than  the  puls*  ( 1 )  is  also  preserved  In  DW  MTM 
filtering  if  the  large  window  size  is  no  larger 
than  21*1 

It  is  interesting  to  not*  that  the  MTM  and 
MNN;  filters  can  be  represented  as  a  weighted 
average  of  the  form 


ZZ  a, 


r , s  k+r , 1+s 


'k.l 


ZZ  a 


r,s 


When 

(  1  •  l*k»r.  Its  -  "k.l 
*r.s  "  \ 

'  0  ,  otherwise 


s  q 


(4) 


(5) 


we  get  the  MTM  filter.  The  MNN j  filter  1*  ob¬ 
tained  by  repleclng  *y  j  in  (5)  with  x|jtj.  The 
DW  MTM  filter  can  also'b*  obtained  by  using  the 
large  window  as  W  in  (4)  and  by  using  m^  •  from 
the  small  window  in  (S). 


III.  EXPERIMENTS 

In  this  section  w*  give  some  results  of  the 
application  of  the  above  nonlinear  filters  in 
image  processing.  The  original  image  under 
consideration  consisted  of  100  x  100  pixel  vslues 
with  eight  bits  of  resolution  per  pixel.  It  ws*  a 
geometric  image  of  flat  portions  with  gray  levels 
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